
Claims 

In an electronic device that accepts hand drawn entries, a method for 
recognizingvtne hand drawn entries, comprising the steps of: 

receiviiteeach hand drawn entry as a plurality of sequential points; 
performing: least one of the following steps in any order: 
measuring the^size of the hand drawn entry and comparing the 
size of the hand drawn en^ry to a size range; 

determining the existence and number and angles of vertices in a line 
10 which could be drawn betweenteaid points; 

comparing the results of said at least one step to a set of rules, a 
favorable comparison leading to conclusive identification of the hand drawn 
entry as an identified shape. 



15 2. The method for recognizing hand drawn entries of claim 1 , wherein 

said at least one step includes determining the distance between said vertices. 



20 



3. The method for recognizing hand drawn entries of claim 1, wherein 
said at least one step includes performing a Wide Pen Test. 

4. The method for recognizing hand drawn entries of c?kim 1 , wherein 
said at least one step includes performing a test for Golden Cluesi 
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"he method for recognizing hand drawn entries of claim 1 , wherein 
said at least Vie step includes the step of excluding identification of shapes that 
do not conform bo said set of rules. 



10 




6. The method 
said at least one step 



recognizing hand drawn entries of claim 1 , wherein 



\es excluding identification of shapes that do not 



conform to said set of rules regarding size. 



\ 



7. The method for recognizing hand drawn entries of claim 1 , further 
including a plurality of hand drawn entries, each of said hand drawn entries 
being analyzed individually. 



U1 
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8. The method for recognizing hand drawn entries of claim 1 , further 
including a plurality of hand drawn entries, said\nes being agglomerated and 

15 analyzed as a single entity. 

9. The method for recognizing hand drawn entries of claim 1 , further 
including a plurality of hand drawn entries of different colors, said set of rules 
including color rules to determine agglomeration of said entries as a single 

20 entity. 
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10. The method for programming an electronic device of &aim 1 , further 
including the step of using arrow logics to establish attributes of sa^d identified 
shape. 
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1 1 . The method for programming an electronic device of claim 1 , 
furthe^ncluding the step of creating an info window for at least one of said 
identified\hapes, said info window enabling setting and altering attributes for 
said at least dae identified shape. 

12. The method for recognizing hand drawn entries of claim 1 , further 
including the step of czlajying out further analytic tests to determine the specific 
object type. 
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10 13. The method for recognizing hand drawn entries of claim 1 , wherein 

said at least one step includes determining the angular trend of said plurality of 
sequential points. 

14. The method for recognizing ha^d drawn entries of claim 13, further 
15 including the step of excluding identificatiom^f shapes that do not conform to 
said set of rules regarding angular trend. 



20 



15. The method for recognizing hand drawn Wries of claim 1 , wherein 
said step of measuring the size includes the step of generating a minimum 
bounding rectangle to circumscribe the hand drawn entr 



25 



16. The method for recognizing hand drawn entries of\claim 15, further 
including the step of determining the size of said bounding rectangle, and 
comparing said size to size rules for at least one identifiable shaj: 
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17. The method for recognizing hand drawn entries of claim 3, wherein 
said wicie pen test includes the step of generating a minimum bounding 



rectangle to\ircumscribe the hand drawn entry. 



03 
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18. The method for recognizing hand drawn entries of claim 17, further 
including the step of generating at least one identifiable geometric shape 
inscribed in said boundingV^ectangle, and comparing the coincidence of said 
points of said hand drawn ent\ with a wide pen stroke defining at least one 
identifiable geometric shape. 

19. The method for recognizing^hand drawn entries of claim 18, wherein 

said wide pen stroke is selected to be a predetermined width, and further 

\ 

including the step of adaptively altering saic^predetermined wide pen stroke 
width. 

20. The method for recognizing hand drawnWries of claim 19, wherein 

\ 

the identifiable geometric shape yielding a degree of coincidence greater than a 
predetermined coincidence threshold is determined to be^he shape of said hand 
drawn entry. 

21 . The method for recognizing hand drawn entries of claim 20, further 
including the step of adaptively altering said coincidence threshold. 



22. The method for recognizing hand drawn entries of claim\20, further 

25 including the step of determining the angular trend of said hand dra^n entry. 
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L The method for programming an electronic device of claim 1 1 , 
including Sie step of drawing at least one arrow from an attribute shown in an 
info window to\at least one identified shape outside said info window. 



01 
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24. The method^br recognizing hand drawn entries of claim 1 , further 
including the step of determining the angular orientation of said hand drawn 
entry with respect to a reference orientation. 




25. The method for recognizing hand drawn entries of claim 24, further 
including the step of excluding identification of shapes that do not conform to 



said set of rules regarding angular orientation. 




26. The method for recognizing hand drawn entries of claim 1 , further 

\ 

15 including the step of determining the proximity of said hand drawn entry to 
another graphic object. 




27. The method for recognizing hand drawn entries of claim 26, further 
including the step of excluding identification of shapes tha^do not conform to 
20 said set of rules regarding maximum proximate distance to s|id another graphic 
object. 



29. The method for recognizing hand drawn entries of clainj 1 , further 

including the step of identifying a portion of said hand drawn entryVlrawn more 

25 slowly than other portions of said hand drawn entry. 
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I The method for recognizing hand drawn entries of claim 29, further 
including tfte step of determining the existence of a vertex in said portion of 
said hand drawkentry, and calculating the vertex angle. 

31 . The methochfcr recognizing hand drawn entries of claim 29, wherein 
said portion of said hand ateiwn entry is identified by storing and analyzing 
time of entry data of said plurality of points. 

10 32. The method for recognizing hand drawn entries of claim 30, wherein 

if a vertex angle in said portion of said \and drawn entry is substantially 
orthogonal, said golden clue test provides Increased potential for identifying a 
rectilinear shape. 

15 33. The method for recognizing hand drawi^ntries of claim 30, wherein 

if a vertex angle in said portion of said hand drawn eiray is substantially non- 
orthogonal , said golden clue test provides increased potential for exclusion of 
all rectilinear shapes. 

20 34. The method for recognizing hand drawn entries of craim 30, wherein 

if a pair of vertex angles in said portion of said hand drawn entry Bre 
substantially orthogonal, proximate, and opposite, said golden clue^est 
provides increased potential for identification of a folder shape 
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\5. The method for recognizing hand drawn entries of claim 30, wherein 
said golderhxlue test includes identifying a first-drawn portion of said hand 
drawn entry, (Wermining the existence of a vertex in said first drawn portion of 
said hand drawn entry, and calculating the vertex angle. 
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36. The method for recognizing hand drawn entries of claim 35, wherein 
if a vertex angle in said first-drawn portion of said hand drawn entry is 
substantially orthogonal, said gulden clue test provides increased potential for 
identification of rectilinear shaped 

37. The method for recognizing\and drawn entries of claim 35, wherein 
if a vertex angle in said first-drawn portioii of said hand drawn entry is 
substantially non-orthogonal, said golden clu^ test provides increased potential 
for exclusion of all rectilinear shapes. 



38. The method for recognizing hand drawn entries of claim 1 , further 
including a slice step of identifying three of said pointsrthat are adjacent and 
spaced apart greater than a minimum pixel length distancfe, constructing an 
angle defined by said three points, measuring the constructed angle, and 
20 reiterating said slice step in serial fashion with consecutive pokts of said hand 
drawn entry to include substantially all said points of said hand drawn entry. 



39. The method for recognizing hand drawn entries of claim 38, further 

including the step of storing the angle measurement of a slice when it exceeds a 

25 predetermined angle threshold. 
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/The method for recognizing hand drawn entries of claim 39, further 
including theSstep of reducing said predetermined angle threshold whenever 
said reiterated slice step yields an angular measurement less than said 
predetermined angle^hreshold. 



10 



41 . The method fortecognizing hand drawn entries of claim 39, wherein 
if an angle measurement of a given slice step exceeds said predetermined angle 
threshold, and the angle measurement of the subsequent slice step is less than 
said predetermined angle threshold\ vertex is identified in the portion of said 
hand drawn entry containing said givenvslice step. 



Ul 



42. The method for recognizing hand^rawn entries of claim 1 , wherein 
said at least one step includes detecting and storing the first pen down location 

15 of said hand drawn entry. 

43. The method for recognizing hand drawn entries of claim 1 , wherein 
said at least one step includes detecting and storing the direction of the pen 
stroke of said hand drawn entry. 



20 



44. The method for recognizing hand drawn entries of clami 1 , wherein 
said at least one step includes measuring the speed of drawing said\and drawn 
entry. 



Jaeger Patent Application 

Method For Creating AndOperating Control Systems 
Page 85 of 97 



10 



15 



20 



\45. The method for recognizing hand drawn entries of claim 44, wherein 
said speed of drawing is determined by detecting the point-to-point spacing 
between saiid sequential points of said hand drawn entry, the point-to-point 
spacing varyink directly with said speed of drawing. 

46. The method for recognizing hand drawn entries of claim 44, wherein 
said speed of drawing is\tetermined by recording the time of entry of each of 
said sequential points, and calculating the speed of drawing from said time of 
entry data. 

47. The method for recognizirte hand drawn entries of claim 1 , further 
including the step of weighting the importance of the comparison of results to 

said set of rules, whereby some comparison results are accorded more 

\ 

importance in determining the identified shaf 

48. The method for recognizing hand drawntentries of claim 1 , wherein 
said results of said at least one step include numericakparameters that 
correspond to characteristics of said hand drawn entry, said numerical 

— — — n 

49. The method for recognizing hand drawn entries of claim 48, wherein 
said magic number values are selectively varied in response to inconclusive 
comparisons to said set of rules. 
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50. The method for recognizing hand drawn entries of claim 49, wherein 
said magic number values can be selectively varied by user input. 



51 . In ata electronic device that accepts hand drawn entries, a method for 
5 programming of said device, including the steps of: 

using an inpi\device to freehand draw at least one recognizable hand 
drawn entry; 

performing at leastkme of the following steps in any order: 
converting said at least one recognizable hand drawn entry into a 
10 functional device having a funcfe^on that may be carried out by said electronic 
device; 

converting said at least one recognizable hand drawn entry into an action 
that may be carried out by said electrons device. 




15 52. The method for programming of cl&im 5 1 , further including the step 

of assigning attributes to said recognizable hanckdrawn entry, said attributes 
defining said hand drawn entry as a functional device. 



53. The method for programming of claim 5 1 , farther including the step 
20 of assigning attributes to said at least one recognizable hand drawn entry, said 
attributes comprising at least one action that may be carried^out by said 
electronic device. 



54. The method for programming of claim 5 1 , further including the step 

25 of creating an info window for said at leas t one recognizable hand prawn entry, 
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saidmfo window enabling setting and altering attributes for said at least one 
hand drawh^entry. 

55. The metl^d for programming of claim 51 , further including the step 
5 of creating an info window for determining object recognition tests to identify 
said at least one recognizaWe hand drawn entry. 



Ul 
Q 
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56. The method for prograf^ming of claim 5 1 , further include the step 
of joining a plurality of functional devkes in a utilitarian sequence. 



57. The method for programming of ejaim 56, wherein said utilitarian 
sequence receives a designated input and produces a desired output. 

58. The method for programming of claim 56^. wherein said joining step 
15 includes the step of drawing at least one line extending\o and intersecting said 

functional devices in said sequence. 



59. The method for programming of claim 58, further including the step 
of selecting a line color for said at least one line, said functional devices being 
20 drawn in object colors, the coincidence of said line color and said object colors 
enabling the joining of said line and objects. 



25 



60. The method for programming of claim 5 1 , further including th 
of grouping a plurality of selected functional devices for action in common 
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method for programming of claim 60, wherein said grouping 
step includes tn^step of drawing a line that substantially circumscribes said 
selected functional advices. 

5 62. The method for programming of claim 60, wherein said grouping 

step includes the step of drawing a line that substantially intersects said 
selected functional devices. 

63. The method for programming of claim 60, wherein said grouping 
10 step includes the step of drawing a bracke^that substantially spans said selected 

functional devices. 

64. The method for programming of claim^S 1 , further including the step 
of agglomerating at least two of said hand drawn eyries into a single object. 



15 



65. The method for programming of claim 64, fu^her including the step 
of enabling agglomeration only between at least two of sai^hand drawn entries 
having a common color. 



20 66. The method for programming of claim 5 1 , further inciting the step 

of applying functional parameters to a recognizable hand drawn entfy by 
drawing a line from a functional device having defined functional parameters 
to a recognizable hand drawn entry lacking functional parameters. 
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$7. The method for programming of claim 5 1 , further including the step 
of assigning^ttributes to said at least one recognizable hand drawn entry by 
inputting text. 

5 68. The method far programming of claim 5 1 , further including the step 

of assigning attributes to said at least one recognizable hand drawn entry by 
making entries in an info windW. 

69. The method for programming of claim 5 1 , further including the step 
10 of assigning attributes to said at least ong recognizable hand drawn entry by 
inputting at least one verbal statement. 



15 



70. The method for programming of clrnm 5 1 , further including 
providing an info window for each recognizableXand drawn entry, said info 
window enabling setting and altering attributes ofskid at least one recognizable 
hand drawn entry. 



71 . The method for programming of claim 70, whefein said info window 
attributes include the aesthetic properties of said recognizably hand drawn 
20 entry. 



72. The method for programming of claim 70, wherein said^nfo window 
attributes include the definition of recognizable hand drawn entry. 
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73. The method for programming of claim 70, wherein said info window 
attributes include the action of said recognizable hand drawn entry. 



74. TheSnethod for programming of claim 70, wherein said info window 
5 attributes include tfte assignment of said recognizable hand drawn entry. 

75. The method for programming of claim 74, wherein said assignment 
sets forth the ability of said recognizable hand drawn entry to acquire the 
attributes of another recognizabl^and drawn entry that is disposed within a 

10 predetermined proximity. 



76. The method for programming oftclaim 51 , further including 
inputting a plurality of said recognizable handydrawn entries. 



□ 



15 77. The method for programming of claim 7(5, further including the step 

of connecting said plurality of recognizable hand draw<n entries. 



78. The method for programming of claim 77, wherein said connected 
recognizable hand drawn entries receive a selected input and produce a desired 
20 output. 
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79. The method for programming of claim 77, wherein said stVp of 
connecting includes drawing a line that extends to each of said plurality^of 
recognizable hand drawn entries. 
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^0. The method for programming of claim 76, further including the step 
of groupin^said plurality of recognizable hand drawn entries for action in 
common. 

5 81 . The method f&c programming of claim 80, wherein said grouping 

step includes drawing a bracket that encompasses said plurality of recognizable 
hand drawn entries. 

82. The method for programmin^f claim 5 1 , further including the step 
10 of using arrow logics to establish attributes\f said at least one recognizable 
hand drawn entry. 



15 



83. The method for programming of claim 5 N further including the step 
of applying a physical control device on-screen to saidYt least one functional 
device, said physical control device enabling a user to inp^t variable control 
values to said at least one functional device. 



20 



84. The method for programming of claim 83, wherein sai\physical 
control device comprises a crack-and-peel controller. 

85. The method for programming of claim 5 1 , wherein said devic 
includes a telephone, and further including the step of selective call blocking. 



25 



86. The method for programming of claim 85, including the step of * 
assigning telephone numbers to a subset of said functional devices, drawing a 
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symboPr^presenting the call blocking function, and drawing an arrow from 
said symbol tb^one of said subset of functional devices to block calls from the 
telephone number represented by said one functional device. 



5 87. The method for pogramming of claim 5 1 , wherein said device 

includes a telephone, and furthekincluding the step of selective call answering. 



88. The method for programming an electronic device of claim 87, 
including the step of assigning telephone numbers to a first subset of said 

10 functional devices, assigning different answe&ng messages to a second subset 
of said functional devices, and drawing an arrowrom one of said second 
subset of functional devices to one of said first sublet of functional devices to 
assign the respective answering message to a call fron^a respective telephone 
number. 

15 

89. The method for programming an electronic device\f claim 5 1 , 
wherein said device displays a signal waveform, and said functional device 
comprises a chop tool juxtaposed over said signal waveform, said signal 
waveform being cut off at the point of intersection of said waveform \nd said 

20 chop tool. 



90. The method for programming of claim 76, wherein said plurality \f 
recognizable hand drawn entries comprise an audio control panel. 
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9r^The method for programming of claim 76, further including the step 
of conveying tn^attributes of one functional device to another functional 
device by drawing ah^arrow from said one functional device to said another 
functional object. 

92. The method for programming of claim 51 , wherein said recognizable 
hand drawn entry comprises an arrow, and further including the step of 
recognizing the start point and end poinVpf said arrow. 



la J 



ni 
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10 93. The method for programming of claim 92, wherein said arrow is 

assigned the function of conveying attributes froina recognizable hand drawn 
entry proximate to said starting point to a recognizat^e hand drawn entry 
proximate to said end point. 

15 94. The method for programming of claim 92, where\i said arrow is 

assigned the function of copying a recognizable hand drawn erttry proximate to 
said starting point to a location proximate to said end point. 

95. The method for programming an electronic device of claiirk 1 1 , 
20 including the step of drawing at least one arrow to an attribute shown in^an info 

window from at least one identified shape outside said info window. 

96. The method for recognizing hand drawn entries of claim 40, 

the maximum total reduction of said predetermined angle threshold is 

25 determined by a user-define d parameter. 
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97. Th^nethod for programming of claim 5 1 , further including the step 
of creating an info\indow for said at least one recognizable hand drawn entry, 
each info window storrfcg parameters determining the function of said at least 
one recognizable hand drawn entry. 

98. The method for programming an electronic device of claim 54, 
including the step of drawing at leas\one arrow to an attribute shown in an info 
window from at least one identified shafoe outside said info window. 

99. The method for programming an electronic device of claim 54, 
including the step of drawing at least one arrow from an attribute shown in an 
info window to at least one identified shape outside^said info window. 

100. The method for programming an electronic device of claim 51 , 
wherein said device displays a graphic object, and said functional device 
comprises a chop tool juxtaposed over said graphic object, said graphic object 
being cut off at the line of intersection of said graphic object an^said chop 
tool. 



101 . The method for programming of claim 91 , further including^ the 
step of modifying the attribute conveyed by an arrow by entering a text 
command proximate to said arrow. 
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lOZ^he method for programming of claim 92, further including the 
step of providing^i=nfo window for said arrow, said info window enabling 
setting and modifying attnbiites of said arrow. 




103. The method for programming^of claim 70, wherein said info 
window attributes include the function of a recognizable hand drawn entry. 
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